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WHAT IS CLAIMED IS: 

1 . A method for out of order read or write scheduling using at least one 
queue, comprising: 

sorting memory transactions into at least one queue; 

within at least one queue, sorting memory transactions by attributes; 

scheduling memory transactions out of order in accordance with scheduling 
algorithms, wherein if a DRAM command of a later memory transaction is scheduled 
before the last DRAM command of an earlier memory transaction, the later memory 
transaction is considered scheduled out of order and wherein the entire at least one queue 
is considered while making scheduling decisions; 

making out of order selection at the time of DRAM command launch. 

2. The method claimed in claim 1, wherein making out of order selection at 
the time of DRAM command launch further comprises: 

in response to making an out of order selection at the time of DRAM command 
launch and not earlier, allowing at least one queue to fill up without delaying the DRAM 
command. 

3. The method claimed in claim 1, further comprising: 
accommodating page closing policy with no prior assumption being made about 

pages being in a particular page miss or page empty or page hit state. 

4. The method claimed in claim 1, wherein a selected write may be 
preempted by a read to optimize latency. 

5. The method claimed in claim 1, further comprising: 

selectively scheduling DRAM commands at intervals longer than minimum 
DRAM timings core timings to accommodate higher density of command scheduling 
achieved from out of order scheduling. 
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6. The method claimed in claim 1, wherein there is a queue for each bank 
and rank combination. 

7. The method claimed in claim 1, wherein within at least one queue, sorting 
memory transactions by attributes further comprises: 

sorting memory transactions into queues in response to attributes such as address 
and address mapping used by memory, processor priority and demand versus prefetch 
transaction type. 

8. The method claimed in claim 1, further comprising: 

determining globally oldest unblocked memory transaction and locally oldest 
unblocked memory transaction for each queue; 

determining whether last scheduled read was a page hit and more unblocked read 
page hits are queued to that same page, and either consecutive number of page hits 
serviced from that page is less than a predefined number or no reads pending to other 
banks. 

9. The method claimed in claim 8, further comprising: 

in response to absence of a globally oldest unblocked read that is a page hit, last 
scheduled read that is a page hit, oldest of the locally oldest unblocked page hit and 
oldest of the locally oldest page empty existing, scheduling a globally oldest unblocked 
read page miss. 

10. The method claimed in claim 8, further comprising 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing a count, else setting the number of 
consecutive hits to zero; 

in response to no consecutive page hits selected, resetting count to zero; 
resetting the last scheduled read to hit in response to read queues being 
empty for preset duration; and 

returning to start of the scheduling cycle. 
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11. The method claimed in claim 8, wherein the globally oldest unblocked 
memory transaction and locally oldest unblocked memory transaction for each queue 
may be a read hit, empty or miss. 

12. The method claimed in claim 8, wherein determining whether last 
scheduled read was a page hit and more unblocked read page hits are queued to that same 
page, and either consecutive number of page hits serviced from that page is less than a 
predefined number or no reads pending to other banks further comprises: 

scheduling an unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else setting the number of 
consecutive hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero; 

resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

13. The method claimed in claim 8, wherein in response to a globally oldest 
unblocked read being a page hit, scheduling a globally oldest unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else setting the number of 
consecutive hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero; 

resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

14. The method claimed in claim 8, wherein determining whether the last 
scheduled read is a page hit further comprises: 

scheduling the globally oldest unblocked read; 
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in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero; 
resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

15. The method claimed in claim 8, wherein determining whether the oldest of 
the locally oldest unblocked page hit exists further comprises: 

scheduling the oldest of the locally oldest unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting count to zero; 
resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

16. The method claimed in claim 8, wherein determining whether the oldest of 
the locally oldest page empty exists further comprises: 

scheduling the oldest of the locally oldest unblocked page empty; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting count to zero; 
resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 



21 



Attorney Docket: P16243 



17. The method claimed in claim 1, wherein scheduling memory transactions 
out of order in accordance with scheduling algorithms, further comprises: 

in response to absence of an unblocked previously scheduled page miss or page 
empty, last scheduled read that is a page hit and non-conflicting unblocked read, 
scheduling an oldest unblocked read transaction. 

18. The method claimed in claim 17, further comprising: 

in response to an unblocked previously scheduled page miss or page empty, 
scheduling a next DRAM command for the oldest page miss or page empty. 

19. The method claimed in claim 17, further comprising: 

in response to a last scheduled read being a page hit, scheduling an oldest 
unblocked transaction and updating a last scheduled read. 

20. The method claimed in claim 17, further comprising: 

in response to the last scheduled read being a page hit, scheduling an oldest non- 
conflicting unblocked read transaction and updating a last scheduled read. 

21. The method claimed in claim 1, wherein scheduling memory transactions 
out of order in accordance with scheduling algorithms, further comprises: 

in response to absence of a globally oldest unblocked page hit and globally oldest 
unblocked page empty, scheduling an oldest unblocked read transaction. 

22. The method claimed in claim 21 , further comprising: 

in response to a globally oldest unblocked page hit, scheduling the oldest 
unblocked page hit. 

23 The method claimed in claim 21 further comprising: 
in response to globally oldest unblocked page empty, scheduling the oldest 
unblocked page empty. 
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24 The method claimed in claim 1, wherein scheduling memory transactions 
out of order in accordance with scheduling algorithms, further comprises: 

in response to absence of an unblocked write that is on-page to last scheduled 
write and non-conflicting unblocked write, scheduling the oldest unblocked write 
transaction and updating the last scheduled write. 

25. The method claimed in claim 24, further comprising: 

in response to an unblocked write that is on-page to a last scheduled write, 
scheduling an unblocked on-page write and updating the last scheduled write. 

26. The method claimed in claim 24, further comprising: 

in response to non-conflicting unblocked write, scheduling selected non- 
conflicting unblocked write transaction and updating the last scheduled write. 

27. The method claimed in claim 1, wherein scheduling memory transactions 
out of order in accordance with scheduling algorithms, further comprises: 

in response to absence of a last scheduled write that is a page hit and a non- 
conflicting unblocked write, scheduling the oldest unblocked write transaction and 
updating the last scheduled write. 

28. The method claimed in claim 27, further comprising: 

in response to a last scheduled write is a page hit, scheduling the oldest unblocked 
transaction and updating the last scheduled write. 

29. The method claimed in claim 27, further comprising: 

in response to a non-conflicting unblocked write, scheduling the oldest non- 
conflicting unblocked write transaction and updating the last scheduled write. 

30. A machine readable medium having stored therein a plurality of machine 
'readable instructions executable by a processor for out of order memory scheduling using 
at least one queue, comprising: 
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instructions to sort memory transactions into at least one queue; 
instructions to, within at least one queue, sorting memory transactions by 
attributes; 

instructions to schedule memory transactions out of order in accordance with 
scheduling algorithms, wherein if a DRAM command of a later transaction is scheduled 
before the last DRAM command of an earlier transaction, the later transaction is 
considered scheduled out of order and wherein the entire at least one queue is considered 
while making scheduling decisions; and 

instructions to make out of order selection at the time of DRAM command 

launch. 

3 1 . The machine readable medium claimed in claim 30, wherein making out 
of order selection at the time of DRAM command launch further comprises: 

instructions to, in response to making an out of order selection at the time of 
DRAM command launch and not earlier, allow at least one queue to fill up without 
delaying the DRAM command. 

32. The machine readable medium claimed in claim 30, further comprising: 
instructions to accommodate page closing policy with no prior assumption being 

made about pages being in a particular page miss or page empty or page hit state. 

33. The machine readable medium claimed in claim 30, further comprising: 
instructions to preempt a selected write transaction by a read transaction to optimize 
latency. 

34. The machine readable medium claimed in claim 30, further comprising: 
instructions to selectively schedule DRAM commands at intervals longer than 

minimum DRAM timings core timings to accommodate higher density of command 
scheduling achieved from out of order scheduling. 
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35. The machine readable medium claimed in claim 30, wherein there is a 
queue for each bank and rank combination. 

36. The machine readable medium claimed in claim 30, wherein instructions 
to within at least one queue, sort memory transactions by attributes further comprises: 

instructions to sort memory transactions into queues in response to attributes such 
as read address and address mapping used by memory, processor priority and demand 
versus prefetch transaction type. 

37. An apparatus comprising: 

at least one queue associated with a memory bank for receiving memory 
transactions sorted by attributes; 

a page table to store information related to memory transactions; and t 

a comparator and selector for receiving unblocked memory transactions from at 
least one queue and receiving page table information to determined if the unblocked 
transaction is a page hit, page miss or page empty, 

wherein memory transactions are scheduled out of order in accordance with 
scheduling algorithms, the entire at least one queue is considered while making 
scheduling decisions and out of order selections are made at the time of DRAM 
command launch. 

38. The apparatus claimed in claim 37, wherein if a DRAM command of a 
later memory transaction is scheduled before the last DRAM command of an earlier 
memory transaction, the later memory transaction is considered scheduled out of order. 

39. The apparatus claimed in claim 37, further comprising: 

an arbitrator for prioritizing between read and write memory transactions. 

40. The apparatus claimed in claim 37, further comprising: 

a content associative memory (CAM) to determine if memory transactions 
are page hits or misses. 
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41. The apparatus claimed in claim 40, wherein the memory transactions 
comprise write transactions. 

42. The apparatus claimed in claim 37, wherein in response to making an out 
of order selection at the time of DRAM command launch, at least one queue fills up 
without delaying the DRAM command. 

43. The apparatus claimed in claim 37, wherein page closing policy 
accommodations are made with no prior assumption about pages being in a particular 
page miss or page empty or page hit state. 

44. The apparatus claimed in claim 37, DRAM commands are selectively 
scheduled at intervals longer than minimum DRAM timings core timings to 
accommodate higher density of command scheduling achieved from out of order 
scheduling. 

45. The apparatus claimed in claim 37, wherein there is a queue for each bank 
and rank combination. 

46. The apparatus claimed in claim 37, wherein within at least one queue, 
memory transactions are sorted into at least one queue in response to attributes such as 
address and address mapping used by memory, processor priority and demand versus 
prefetch transaction type. 

47. A system comprising: 

a memory including a plurality of banks; and 

a memory controller operatively in communication with the memory; 
at least one queue associated with a memory bank for receiving memory 
transactions sorted by attributes; 

a page table to store information related to memory transactions; and 
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a comparator and selector for receiving unblocked memory transactions from at 
least one queue and receiving page table information to determined if the unblocked 
transaction is a page hit, page miss or page empty, 

wherein memory transactions are scheduled out of order in accordance with 
scheduling algorithms, the entire at least one queue is considered while making 
scheduling decisions and out of order selections are made at the time of DRAM 
command launch. 

48. The system claimed in claim 47, wherein if a DRAM command of a later 

memory transaction is scheduled before the last DRAM command of an earlier memory 

i 

transaction, the later memory transaction is considered scheduled out of order. 

49. A method for out of order memory read scheduling using multiple queues, 
comprising: 

determining a globally oldest unblocked memory transaction and locally oldest 
unblocked memory transaction for each queue; 

determining whether a last scheduled read was a page hit and more unblocked 
read page hits are queued to that same page, and either consecutive number of page hits 
serviced from that page is less than a predefined number or no reads pending to other 
banks. 

50. The method claimed in claim 49, further comprising: 

in response to absence of a globally oldest unblocked read that is a page hit, last 
scheduled read that is a page hit, oldest of the locally oldest unblocked page hit and 
oldest of the locally oldest page empty existing, scheduling a globally oldest unblocked 
read page miss. 

5 1 . The method claimed in claim 49, further comprising 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing a count, else setting the number of 
consecutive hits to zero; 
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in response to no consecutive page hits selected, resetting count to zero; 
resetting the last scheduled read to hit in response to read queues being 
empty for preset duration; and 

returning to start of the scheduling cycle. 

52. The method claimed in claim 49, wherein the globally oldest unblocked 
memory transaction and locally oldest unblocked memory transaction for each queue 
may be a read hit, empty or miss. 

53. The method claimed in claim 49, wherein determining whether last 
scheduled read was a page hit and more unblocked read page hits are queued to that same 
page, and either consecutive number of page hits serviced from that page is less than a 
predefined number or no reads pending to other banks further comprises: 

scheduling an unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else setting the number of 
consecutive hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero; 

resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

54. The method claimed in claim 49, wherein in response to a globally oldest 
unblocked read being a page hit, scheduling a globally oldest unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else setting the number of 
consecutive hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero; 

resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 
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55. The method claimed in claim 49, wherein determining whether the last 
scheduled read is a page hit further comprises: 

scheduling the globally oldest unblocked read; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting the count to zero;' 
resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

56. The method claimed in claim 49, wherein determining whether the oldest 
of the locally oldest unblocked page hit exists further comprises: 

scheduling the oldest of the locally oldest unblocked page hit; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting count to zero; 
resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

57. The method claimed in claim 49, wherein determining whether the oldest 
of the locally oldest page empty exists further comprises: 

scheduling the oldest of the locally oldest unblocked page empty; 

in response to a scheduled page hit and a last scheduled read that is also a page hit 
and both are to the same page, incrementing the count else set the number of consecutive 
hits to zero; 

in response to no consecutive page hits selected, resetting count to zero; 
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resetting the last scheduled read to hit in response to read queues being empty for 
preset duration; and 

returning to start of the scheduling cycle. 

58. A method for out of order read scheduling using at least one queue, 
comprising: 

in response to absence of an unblocked previously scheduled page miss or page 
empty, last scheduled read that is a page hit and non-conflicting unblocked read, 
scheduling an oldest unblocked read transaction. 

59. The method claimed in claim 58, further comprising: 

in response to an unblocked previously scheduled page miss or page empty, 
scheduling a next DRAM command for the oldest page miss or page empty. 

60. The method claimed in claim 58, further comprising: 

in response to a last scheduled read being a page hit, scheduling an oldest 
unblocked transaction and updating a last scheduled read. 

61 . The method claimed in claim 58, further comprising: 

in response to the last scheduled read being a page hit, scheduling an oldest non- 
conflicting unblocked read transaction and updating a last scheduled read. 

62. A method for out of order read scheduling using a queue, comprising: 

in response to absence of a globally oldest unblocked page hit and globally oldest 
unblocked page empty, scheduling an oldest unblocked read transaction. 

63. The method claimed in claim 62, further comprising: 

in response to a globally oldest unblocked page hit, scheduling the oldest 
unblocked page hit. 
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64. The method claimed in claim 62, further comprising: 

in response to globally oldest unblocked page empty, scheduling the oldest 
unblocked page empty. 

65. A method for out of order write scheduling using at least one queue, 
comprising: 

in response to absence of an unblocked write that is on-page to last scheduled 
write and non-conflicting unblocked write, scheduling the oldest unblocked write 
transaction and updating the last scheduled write. 

66. The method claimed in claim 65, further comprising: 

in response to an unblocked write that is on-page to a last scheduled write, 
scheduling an unblocked on-page write and updating the last scheduled write. 

67. The method claimed in claim 65, further comprising: 

in response to non-conflicting unblocked write, scheduling selected non- 
conflicting unblocked write transaction and updating the last scheduled write. 

68. A method for out of order write scheduling using at least one queue, 
comprising: 

in response to absence of a last scheduled write that is a page hit and a non- 
conflicting unblocked write, scheduling the oldest unblocked write transaction and 
updating the last scheduled write. 

69. The method claimed in claim 68, further comprising: 

in response to a last scheduled write is a page hit, scheduling the oldest unblocked 
transaction and updating the last scheduled write. 

70. The method claimed in claim 68, further comprising: 

in response to a non-conflicting unblocked write, scheduling the oldest non- 
conflicting unblocked write transaction and updating the last scheduled write. 
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